Modular Dynamic Neural Network: A Continual Learning Architecture
نویسندگان
چکیده
Learning to recognize a new object after having learned other objects may be simple task for human, but not machines. The present go-to approaches teaching machine set of are based on the use deep neural networks (DNN). So, intuitively, solution fly should DNN. problem is that trained DNN weights used classify initial extremely fragile, meaning any change those can severely damage capacity perform recognitions; this phenomenon known as catastrophic forgetting (CF). This paper presents (DNN) continual learning (CL) architecture deal with CF, modular dynamic network (MDNN). presented consists two main components: (a) ResNet50-based feature extraction component backbone; and (b) classification component, which multiple sub-networks progressively builds itself up in tree-like structure rearranges it learns over time such way each sub-network function independently. contribution strongly its training feature. allows classes added while only altering specific previously forgotten. Tests CORe50 dataset showed results above state art CL architectures.
منابع مشابه
A modular neural network architecture for inverse kinematics model learning
In order to reach an object, we need to solve the inverse kinematics problem, i.e., the coordinate transformation from the visual coordinates to the joint angle vector of the arm. The learning of the inverse kinematics model for calculating every joint angle that would result in a speci"c hand position is important. However, the inverse kinematics function of the human arm is a multi-valued and...
متن کاملA Neural Network Modular Architecture For Network Traffic Management
With the rapid evolution of telecommunication networks, real-time traffic management is becoming more and more crucial. We propose here a neural network modular architecture for performing diagnosis at different levels of the telephone network. This system is designed as an aid to the operator. We present results of different experiments with a first version of the architecture which mainly ope...
متن کاملContinual Robot Learning withConstructive Neural
In this paper, we present an approach for combining reinforcement learning, learning by imitation, and incremental hierarchical development. We apply this approach to a realistic simulated mobile robot that learns to perform a navigation task by imitating the movements of a teacher and then continues to learn by receiving reinforcement. The behaviours of the robot are represented as sensation-a...
متن کاملA Parallel and Modular Multi - Sieving Neural Network Architecture for Constructive Learning
In this paper we present a parallel and modular multi-sieving neural network (PMSN) architecture for constructive learning. This PMSN architecture is dierent from existing constructive learning networks such as the cascade correlation architecture. The constructing element of the PMSNs is a compound modular network rather than a hidden unit. This compound modular network is called a sieving mod...
متن کاملModular Continual Learning in a Unified Visual Environment
A core aspect of human intelligence is the ability to learn new tasks quickly and switch between them flexibly. Here, we describe a modular continual reinforcement learning paradigm inspired by these abilities. We first introduce a visual interaction environment that allows many types of tasks to be unified in a single framework. We then describe a reward map prediction scheme that learns new t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2021
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app112412078